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Abstract 

Suppose Xi, X2, ■ ■ ■ are i.i.d. nonnegative random variables with finite expectation, 
and for each k, Xk is observed at the fc-th arrival time Sk of a Poisson process with 
unit rate which is independent of the sequence {^fe}. For t > 0, comparisons are made 
between the expected maximum M{t) :— E[maxfc>i 1(5^ < t)] and the optimal 
stopping value V{t) sup^i^-j-E[Xrl{Sr < t)], where T is the set of all IN-valued 
random variables r such that {r — i} is measurable with respect to the cr-algebra 
generated by {Xi, Si), . . . , {Xi,Si). For instance, it is shown that M{t)/V{t) < 1 + 
ao, where ao = 0.34149 satisfies /q^Cj/ — yhiy + ao)~^ dy = 1; and this bound is 
asymptotically sharp as i ^ 00. Another result is that M{t)/V{t) < 2 — (1 — e~*)/t, 
and this bound is asymptotically sharp as t | 0. Upper bounds for the diff'erence 
M{t) — V{t) are also given, under the additional assumption that the Xk are bounded. 

AMS 2000 subject classification: 60G40, 62L15. 
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1 Introduction 

Suppose an item is for sale, and independent, identicahy distributed price offers Xi, X2, . . . 
arrive according to a Poisson process with rate A. The item must be sold by a fixed time 
t > 0, or it becomes worthless. If Si denotes the arrival time of the i-ih. offer, the optimal 
expected return is given by 

V{t) := supE[X^I(5^ < t)], 

where T is the set of all IN-valued random variables (stopping rules) r such that {r = i} 
is measurable with respect to the a-algebra generated by (Xi, ^i), . . . , (Xj, Si). Assuming 
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the price offers are independent of the arrival process, Karhn (1962) showed that V{t) is 
the unique solution of the initial value problem 

V' = X E{Xi - V)+, V{0) = 0, (1) 

and the optimal policy is to accept the first offer whose value X exceeds V{t), where r 
is the amount of time remaining when the offer arrives. Sakaguchi (1976) gives explicit 
solutions of ([T]) for several common distributions of Xi . 

The purpose of this paper is to compare V{t) with the expected maximum 

M{t) :=E{max{Xi,...,XNit)}), 

where N(t) denotes the number of arrivals up to time t. (The maximum of an empty set 
is taken to be zero.) In particular, reasonably tight upper bounds are given for the ratio 
M{t)/V{t) and the difference M{t) — V{t), the latter under the additional assumption that 
the price offers are uniformly bounded. 

Note that M{t) may be interpreted as the optimal expected return to a player endowed 
with complete foresight, who is able to predict both the values and the arrival times of 
future price offers. Such a player would of course accept the largest offer made available 
before the deadline. Hence, comparisons of V{t) and M(t) can be interpreted as bounds on 
the value of inside information in investing. For instance, consider two investors holding 
identical assets. One investor has no inside information, and therefore does not know when 
offers will be made or what the sizes of the offers will be. The other, better connected, 
investor happens to know that a certain firm is considering to make a bid within the next 
few days, and perhaps even knows the likely size of the bid. The inequalities developed 
in this paper can be used to bound the advantage of the second investor over the first 
investor. 

Analogous comparisons in the discrete-time setting are known in the literature as 
prophet inequalities. Specifically, let Zi, . . . , Z„ be independent nonnegative random vari- 
ables with finite expectations, and define the quantities 

Vn ■= V{Zi, . . . , Zn) := sup{E : T is a stopping rule for Zi, . . . , Z^}, 

and 

M„ := E(max{Zi, . . . , Z„}). 

Krengel and Sucheston (1978) proved that M„ < 2Vn, with strict inequality if Zi, . . . , Z„ 
are not all identically equal to zero. Hill and Kertz (1981) showed that if, instead of being 
nonnegative, the Zj take values in an interval [a,b], then M„ — Vn < (6 — a)/4. While 
the constants 2 and 1/4 are best-possible in general, sharper bounds hold if the Zj are 
known to be identically distributed. Hill and Kertz (1982) constructed the best-possible 
constants o„ and bn (n = 2,3,...) such that (a) if Zi,...,Z„ are i.i.d. nonnegative 
random variables, then M„ < anVn] and (b) if Zi, . . . , Z„ are i.i.d. taking values in [a, b], 
then Mn — Vn ^ bn(b — a). The constants a„ and 6„ play a prominent role in the present 
article. Their rather technical definitions are given in Section [2] below. 
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There are a few important differences between the classical discrete-time setting and 
the continuous-time setting considered here. First, since there is no upper bound on the 
possible number of observations in the interval [0,t], the usual technique of backward 
induction can not be applied here. This makes it impossible to reduce the problem of 
finding sharp inequalities to a finite-dimensional optimization problem, as was done by 
Hill and Kertz (1982). Second, even though Xi, X2, ■ ■ ■ are i.i.d., the random variables 
XkHSk < t), e IN are in fact positively dependent, with expectations decreasing to zero. 

Given these difficulties, it seems unlikely that completely sharp but explicit prophet 
inequalities can be found for the continuous-time setting. In this paper, four inequalities 
are proved: two for the ratio M{t)/V{t), and two for the difference M{t) — V{t), the latter 
under the additional assumption that the Xk are bounded. The upper bounds given in 
Section[3]are constant in t, and are asymptotically sharp as t — > 00. These bounds make use 
of the Hill-Kertz constants {a„} and {bn}. Obviously, such bounds are far from sharp when 
t is small, since the prophet's advantage disappears as the expected number of observations 
approaches zero. Therefore, a second pair of bounds, which are asymptotically sharp as 
t I 0, is given in Section [H The proofs of these bounds rely on the use of threshold stopping 
rules. 

Section [5] provides some estimates on how close to being sharp the bounds of Sections [3] 
and m are. Finally, Section [6] discusses more general renewal processes. 

Throughout the paper it is assumed that A = 1. However, all of the results can be 
restated easily (with only trivial modifications) for arbitrary A > and, more generally, 
for any non-homogeneous Poisson process. 

2 Notation and the Hill-Kertz constants 

Throughout the paper, X,Xi,X2, ■ ■ ■ denote nonnegative i.i.d. random variables with 
finite expectation, where it is assumed that P(X = 0) < 1. For real numbers x and y, xVy 
denotes the maximum of x and y. To emphasize the dependence of M{t) and V{t) on the 
distribution of X, they will sometimes be written as M{t;X) and V{t;X), respectively. 
For s > 0, set X* := maxjXi, . . . , Xjv(s)}. 

We next introduce the constants {a„} and {bn} mentioned in the introduction. The 
definitions below are taken from Hill and Kerz (1982). For n > 1 and w,x € [0,oo), let 
4>n{w, x) = (n/ {n — l))zi;("~^)/"' + x/(n — 1). For a G [0, 00), define r/o,n(a) = 0n(O, a), and 
inductively, rjj^nict) = cj}n{rij-i,nice), (x) for j > 1. In their Propositions 3.4 and 3.8, Hill 
and Kertz show that 

(i) there is a unique a„ G (0, 1) such that r7„_i^„(a„) = 1; and 

(ii) there is a unique /3„ G (0, 1) such that (n — l)[r/„^„(/5„) — fyn-i,n.(/3n)] = 1- 

Kertz (1986; Lemma 6.2(b)) proves further that lim„_+oo a„ = ao, where oq = 0.34149 is 
the unique value of a such that J^{y — ylny + a)^^ dy = 1. Table [1] below gives sample 
values of a„ and /3„. 

Now let On := 1 + and bn ■= Pn- 
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n 


On 




n 


an 




2 


.17157 


.06250 


8 


.29166 


.09768 


3 


.22138 


.07761 


9 


.29683 


.09911 


4 


.24811 


.08539 


10 


.30101 


.10027 


5 


.26496 


.09020 


100 


.33716 


.11010 


6 


.27659 


.09348 


10^ 


.34144 


.11125 


7 


.28513 


.09586 


10^ 


.34149 


.11126 



Table 1: Selected values of and /3, 



Theorem 2.1 (a) [Hill and Kertz, 1982; Theorem A] If Zi, . . . ,Zn are i.i.d. nonnegative 
random variables, then E(Zi V • • • V Z„) < anV{Zi , . . . , Z„) . This bound is sharp, and holds 
with strict inequality if Z\ is not identically equal to zero. 

(b) [Hill and Kertz, 1982; Theorem B] If Zi, . . . , Zn are i.i.d. random variables taking 
values in [a, b], then E(Zi V • • • V Zn) — V{Zi, . . . , Zn) < bn{b — a). This bound is attained. 

3 Long-range prophet inequalities 

This section develops upper bounds for the ratio and difference of M{t) and V{t) which 
are fairly sharp when t is large. The following simple inequality will be helpful. 

Lemma 3.1 For all s > and all c > 0, 

E{X*-c)+ <sE{X-c)+, 
with strict inequality ifF{X > c) > 0. 

Proof. This follows easily by conditioning on N{s), and using the fact that E(Xi V • • • V 
^n — c)^ < n'E{X — c)"*" for every n, with strict inequality if n > 2 and P(X > c) > 0. □ 

Theorem 3.2 Let oq be as in Section\^ For all t > Q, 

M{t) < {l + ao)V{t). 

Proof. Fix n > 2, and let 6 := t/n. Consider a "partial prophet" who has limited foresight 
in the sense that he can see, at the beginning of each time interval := {{i — 1)6, i6], 
i = 1, . . . ,n, all of the observations (if any) arriving in that interval. For i = 1, . . . ,n, 
let Zi denote the largest of the observations arriving in the interval (or = if no 
observations arrive in that interval). A routine exercise shows that Zi, . . . , Zn are i.i.d. 

Let Vj := y(Zj_|_i, . . . , Z„), j = 0, l,...,n — 1, and put f„ := 0. Since the partial 
prophet sequentially observes Zi, . . . , Z„, his optimal expected return is vq, and by back- 
ward induction (see p. 50 of Chow et al., 1971), his optimal rule is to stop in the first time 
interval for which Zi > Vi, and to accept the largest observation, Zi, in that interval. 

Now consider the following stopping rule for the mortal: 
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Accept the first observation Xj such that, if Xj arrives in the time interval /«, 



then Xj > Vi. 



Let Vs{t) denote the expected return from this stopping rule. Define Z'- = Zil{Zi > Vi), 
and let X'- ^,X'-2,--- denote the successive values of those Xj arriving after time {i — 1)6 
for which Xj > Vi. Let N- be the number of such observations (with Xj > vi) that 
arrive in the interval /«. Observe that N[ is Poisson with mean 5V{X > Vi), and Z'^ = 
max{X'- ^, . . . , X'^ ^,}. Thus, Lemma 13.11 applied to X- -^ , X- 2 , . . . yields 



Note that 



and 



EZ'i<6F{X >Vi)EXl^. (2) 

n 

?;o = 5^P(Zi <r;i,...,Z,_i <r;i_i)E[ZJ(Zi>?;i)], (3) 
i=l 

n 

Vsit) = P(Zi <v^,..., < EK^i I(Z, > Vi)]. (4) 



i=l 



Using ([2]), we obtain that 



Y>(N'. > i^i 

E[Xl,l{Z,>v,)]=EXl,nNi>l)>EZ[ ^ ^ - ' 



5P{X>Vi) 



= E[Z,I(Z, >t>i)l(l-e-')A 

where the second inequality follows since (1 — e^^^)/p is decreasing in p. Substituting this 
result into (jl]) and comparing with Q yields the conclusion 

-0 < r^^^(^) < r^{^^(*)- (5) 

By Theorem 12. If a). 

M{t) = E{Xi V • • • V Xjv(t)) = E(Zi V • • • V Z„) < anVQ. 

Hence, 

M{t) < a„^-^^y(i). 
Since n was arbitrary, the theorem follows upon letting n — > 00. □ 
Theorem 3.3 Assume that Xi,X2, ■ ■ ■ are [0, l]-valued. Then for all t > 0, 

M{t) - V{t) < limsup6„. 
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Proof. We use the notation from the proof of Theorem 13.21 Since vq < F{N{t) > 1) = 
1 — e~*, Theorem 12. iT bl and ([5]) imply that 

M{t) - V{t) < 6„ + (1 - e~*) 

Letting n ^ oo completes the proof. □ 

Remark 3.4 The value of lim sup 6„ does not seem to be known at present, though Table[T] 
{bn = Pn) suggests that lim sup 6n ~ .1113. Fortunately, equation ([6]) gives rigorous upper 
bounds by taking n = 10^. For instance, if t = 1000, §1 yields that M{t) - V{t) < .11176. 

Remark 3.5 Theorems 13.21 and 13.31 hold in fact for any non-homogeneous Poisson process 
with rate function X{t), t > 0, provided X{t) is bounded on bounded intervals. This follows 
since in the proof of Theorem 13.21 one may replace the partition {/j } with a partition in 
which the number of arrivals in each interval is Poisson with the same parameter fi = 
(1/n) Jq X{s) ds. The rest of the proof then goes through with ^ in place of 5. 

Remark 3.6 It is possible to quantify how sharp the bounds of Theorems 13.21 and 13.31 are: 
Proposition 4.4 of Hill and Kertz (1982) gives the e-extremal distributions for Theorem 
[2Ha). They satisfy P(Zi = 0) = (?7o,n(an))^/" = {an/{n - 1))^/". By the construction of 
the random variables {Zi} in the proof of Theorem 13.21 Zi must have an atom at zero of 
size at least V{N{5) = 0) = e"^ = e"*/". Vice versa, every distribution on [0, oo) satisfying 
this condition can arise from a suitable choice of the distribution of X. It follows that, if 

t >log((n-l)/a„), 

then for every e > there exists a random variable X and corresponding i.i.d. random 
variables Zi , . . . , Z„ such that 

M(t;X) = E(Zi V--- VZ„) > (a„ - e)y(Zi, . . . , Z„) > [on - e)V {t- X) . 

For example, if t > log(99/aioo) = 5.683, then s\xy>x M{t;X) /V {t;X) > oioo = 1-337. 

Similarly, the extremal distribution for Theorem 12. ll fb) (see Proposition 5.3 of Hill and 
Kertz, 1982) has P(Zi = 0) = (r/o,n(/?n))^/", so as long as t > log((n - l)//?n), there 
exists a [0, l]-valued random variable X such that M{t; X) — V{t; X) > bn. For example, if 
t > log(99//3ioo) = 6.802, then M{t;X) - V{t;X) > 6ioo = 0.110 for a suitable X in [0, 1]. 

Remark 3.7 In contrast with the classical discrete-time setting, there is no obvious gen- 
eralization of Theorem 13.31 to random variables taking values in an arbitrary interval 
[a,b]. Indeed, if X^, is in [a,b], the random variables X^^iSk ^ t) are not in [a,b] but 
in {0} U [a, b]. Hence the difference M{t) — V{t) is not invariant under a shift of the dis- 
tribution of X. A simple example illustrates this: Let X take the values and 1 with 
probabilities 1/2 each; clearly, M{t;X) = V{t;X). Now set X := X + 1, and consider 
the problem of stopping the sequence Xkl{Sk <t). If t is sufficiently small, it is optimal 
for the mortal to accept the first available observation regardless of its value, whereas the 



n(l 



-t/n\ 



for all n > 2. 



(6) 
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prophet can wait for a larger value (which will arrive with positive probability). Hence 
V{t;X) =E[Xil{Si <t)] = {l-e-^)EX < M{t;X). 

On the other hand, if X takes values in [a, b] with < a < 6, then the proofs of 
Theorems 13.21 and 13.31 are easily modified to show that M{t) — V{t) < b ■ limsup„^o^ 
This bound is not, however, very sharp in general. 



4 Short-range prophet inequahties 

The inequalities obtained in the previous section can be improved upon when t (and with it 
the expected number of observations) is small. In this section, we consider pure threshold 
rules of the form r(c) = inf{n : Xn > c}. For c > 0, let Wc{t) denote the expected return 
from the rule r(c). That is, 

Wc{t) := Wc{t; X) := E I(r(c) < N{t))\ . 

It is straightforward to verify that the value of Wc{t) is given by 

Wcit) = [l - e-*P(^^^)j E{X\X > c). (7) 

The next lemma is the key to the results in this section. 

Lemma 4.1 For 7 > 0, the function 

f{x):={l-e-^){l+j/x), x>0 

does not have a local minimum on (0, 00). 

Proof. Twice differentiating / yields that 

fix) + fix) = {j/x'){2 - X - (2 + x)e~-} =: {-i/x^)g{x). (8) 

Observe that 5(0) = ^'(0) = 0, and g"{x) < for all 2; > 0. Thus, by (HD, f'{x) + f"{x) < 
for all rr > 0. But then there cannot exist a point xq > Q such that f'{xQ) = and 
f"{xo) > 0. Since / is smooth, the lemma follows. □ 



Theorem 4.2 For all t > 0, 

and this bound is sharp. 
Corollary 4.3 For all t > 0, 



SUPc Wc(t) 



v{t) ^ t ■ 
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Proof of Theorem\^.S\ For any c > 0, 



E[x;i(x; < c)] < cP(x; < c,iv(t) > i) 

= c{p(x; < c) - p(iv(t) = 0)} 

= cP(X; <c)-ce-*, 

and 

E[x; \{xi > c)] = cP(x; > c) + E(x; - c)+. 

Adding these expressions and applying Lemma 13.11 gives 

ex; < c(1 - e"*) + E(X; - c)+ <c(l-e-*)+tE(X-c)+. (10) 
On the other hand, ^ can be written as 

Now for any a > 0, there exists a unique number c := Ca such that 

E{X - c)+ = ca. (12) 
For this value of c, ([TO]) and ([TT]) combine to give 

M{t) ^ 1 - e"* + to 



W^e(t) - (l-e-*P)(l + a/p)' 

where p := P(X > c). Let (i(|?) := (1 — e~*P)(l + a/p). Using Lemma l4.ll with x = tp 
and 7 = to we find that d{p) is smallest either at p = 0"'' or at p = 1. Thus, noting that 
d{0+) = ta, 

M{t) r 1 - e"* + to 1 - e"* + to 1 

< max < , — _ > . (13) 



Wc{t) - 1 to ' (l-e-*)(l + a)J ■ 

The first term in the maximum is decreasing, and the second increasing in a. Hence, the 
right hand side of (jl3p is minimized when ta = {1 — e~*)(l + a); that is, when 



1 - e-* 

a = a 



t + e-' - 1 

(Note that a* > 0.) For a = a*, the maximum in (jlSp reduces to the right hand side of 
([9]). Finally, the inequality is strict since ([12]) and a* > imply that F{X > Cq,*) > 0, 
giving strict inequality in Lemma l3. II (and hence, in (jlOp ). 

To see that the bound is sharp, let < p < 1, e = {1 — e"^* — p(l — e~*)}/(l— p)(l — e~*), 
and let X have the distribution P(X = 1) = p = 1 — F{X = e). There are only two 
essentially different threshold rules: r(e) and t(1). By the choice of e, 

We{t) = (1 - e-'){p + e(l -p)} = l- e-'P = Wi{t), 
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using ([7]). Furthermore, it is not difficult to compute that 



M(t) = !-(!- e)e-*P - ee~*. 

Thus, 

M{t) _ M{t) _ ^ ^ e(e-*P - e"*) 



svcpcWcit) Wi{t) l-e-*P 



t 

This shows that the inequahty ([9]) is sharp. □ 



(1 - e-*) V 1 - e-*P 

1 - e-* 

as p I 0. 



The next result is a difference inequality for the case when X is bounded. Some 
additional notation is needed. For constants a < b, let '^[a,b] denote the collection of all 
[a, 6]-valued random variables. For any threshold c, define Dc{t; X) := M(t; X) — Wc{t; X). 
For t > 0, let ht : [0, 1] ^ IR be the function 

/it(x) = l-e-*^'-(l-e-*)x. 

Define 7 (t) :=t/(l — e~*), and := 1 — {1 + log7(t)}/7(t). Routine calculus shows that 
f3{t) = maxo<x<i ht{x), and the maximum is attained at x = (log7(t))/t. 

The next minimax-type theorem presents a universal value c* which minimizes the 
largest possible difference Dc{t; X) for X € '^[a,b]- 

Theorem 4.4 Let < a < b. For all t > 0, 

inf sup Dc{t; X) = [b — max{a, c*}]P{t), 

where c* = bp{t)/{(3{t) + 1 — e~*}. Moreover, the infimum is attained by the choice c = c* . 

The proof of Theorem 14.41 uses the concept of balayage. Given X € '^[a,b] and constants 
a < c < d < b, let X^ denote a random variable such that X^ = X if X [c,d], X^ = c 
with probability {d — c)~^E[{d — X)l{c < X < d)], and X^ = d otherwise. It follows 
immediately that EX^ = EX, E{X^\X^ > c) = E{X\X > c), and F{X^ > c) = F{X > c). 
Moreover, Lemma 2.2 of Hill and Kertz (1981) implies that if y is a random variable 
independent of both X and X^, then E{X^ V Y) > E{X V Y). 

Proof of Theorem ]^. ^\ Assume first that c* > a. Let X be any [a, 6]-valued random variable; 
choose c G [a, 6], and define X = X^. By ([7]), Wc{t] X) = Wc(t; X), and by the last remark 
in the previous paragraph, M{t;X) > M{t;X). Therefore, Dc{t; X) > Dc{t]X). So, by 
replacing X with X if necessary, we may assume that P(c < X < 6) = 0. 
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Next, define p := F{X = b), and r := P(X > c). For n > 1, 

E{Xi V • • • V X„) < cP(Xi V • • • V X„ < c) + 6P(Xi V • • • V X„ = 6) 
= c(l - p)" + 6{1 - (1 - p)"} = 6 - (6 - c)(l - pr. 

Thus, 

oo 

M(t; X) < 5^ {6 - (6 - c)(l - pr} P(iV(t) = n) 

n=l 

= (6-c)(l-e-*P) + c(l-e-*). (14) 

On the other hand, by ([7]), 

T^.(t;X) = (l-e--) (c+^^). 

For fixed p, this expression is minimized either when r = p or r = 1, in view of Lemma 
KT[ It follows that 

Wc{t; X) > min{(l - e-*)(c + (6 - c)p), 6(1 - e-*^)}. 

Subtracting from (I14p and rearranging terms, we obtain that 

Dc{t;X) < max{(5 - c)ht{p),c{e-^P - e"*)} 
< max {(6 - c)l3{t), c(l - e"*)} . 

The two terms inside the maximum are equal when c = c* , and so 

Dc*it;X) < {b-c*)(3{t)- 

Suppose next that c* < a. Then the preceding argument (with r = P(X > a) = 1) 
yields that 

D,,{t;X)=Da{t;X) < {b-a)l3{t). 

Conversely, for any c > and e > the distribution of X can be chosen so that 
Dc{t; X)>[b- max{a, c*}]/3(i) - e: 

(i) If c < a, take X G {a,b} with P{X = b) = {log-f{t))/t. Then De{t;X) = {b-a)[5{t). 

(ii) If a < c < c*, take X e {c, 6} with P(X = 6) = (log7(t))/t. Then Dc{t;X) = 
{b-c)m>ip-c*)(3{t). 

(iii) If c > c* and c > a, take X = c — 5, where < 6 < min{e,c — a}. Then 
Dc{t; X) = {c- 6){1 - e-*) > c*(l - e"*) - 6 > {b - c*)P{t) - e. 

Thus, the choice c* is minimax, and the theorem follows. □ 

Corollary 4.5 // X is [a, b]-valued with < a < b, then for all t > 0, 

M{t; X) - V{t- X) < min | (6 - a)/3(t), } ■ (15) 

Remark 4.6 For a non-homogeneous Poisson process with rate function A(x), the bounds 
corresponding to Theorems l4.2l and 14.41 are obtained by replacing t with //(i) := X{x) dx. 
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5 How sharp are the bounds? 

In this section, the ratio and difference of M(t; X) and V{t; X) are examined for random 
variables X taking only finitely many values, say ai < a2 < • ■ ■ < a„, where oi > 0. Put 
ao = 0. For i = 0, 1, . . . , n, define n := F{X > Oi), i^i := E{X - ai)+, and Ei := E{X\X > 
tti). Observe that = 0, and recursively, for = n, ra — 1, . . . , 1, 

/Xjfc_i = E{X - afe)+ + rk{ak - ak-i) = lJ-k + rk{ak - flfe-i)- 

A moment's reflection reveals that there are critical times < < ^2 < " ' ' < C-i < c« 
such that the optimal rule is to accept an observation with value Oj with time r remaining 
if and only if t < t* or i = n. Set = 0, and = oo. For 1 < k < n and t > let 
Vk{t) denote the expected return, with time t remaining, from the rule: 

Accept with time r remaining if and only ii t < t* oi i > k. 

Clearly, it is optimal to accept with time t remaining if and only if > Vk{t). Thus, 
t^. is the unique value of t > such that Vk{t) = a^- For A; = 1, we have 

Vi{t) = {I - e-')Ei, t>0, 

so that 

^1 = -log(l - (ai/Ei)) = -log(//i///o) = log(//o/Ati)- 
And, inductively for = 2, . . . , n — 1 and t > t^.^^, 

Vk{t) = (l - e-'^'=(*-*^-i)) Ek + e-^^^'-'i-M-M-,) 

Thus, 

^_rk{tl-tl_^) _ - Qfc _ fk{Ek - ak) _ l^k 
Ek — ak-\ rk{Ek — a^-i) Hk-i ' 

and so 

= + (l/'^ifc) log(//jk-i//Xfe), A; = 2, . . . , n - 1. 
Finally, when < i < i* (A; = 1, 2, . . . , n), 

V{t) = Vk{t) = Ek- {Ek - afc_i)e-'''=(*-*^-i). (16) 
On the other hand, the prophet's value is easily computed to be 

n 

M{t) = ^{ui - ai_i) (1 - e-'''^) , for all t > 0. (17) 

i=l 
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Example 5.1 Let n = 2, and put ai = 1 and 02 = K, where K is large. Let a be a 
positive real number such that 

log(l + t/a) < t, (18) 
and let r2 = a/{tK). We will examine the ratio R{t) = M{t)/V{t) as K ^ 00. First, by 

M(t) = 1 - e"* + (i^ - 1) f 1 - e"'*/^) ^ 1 - e"* + a, as ^ 00. (19) 



Next, Hi = {a/tK){K — 1) — > a/t, and /^q = ^1 + 1 — > (a/i) + 1, so that 

= log(//o/Aii) ^ log(l + t/a), K ^ 00. 

It follows that t\ <t for sufficiently large K, so by (fTB]) . 

y(t) = - (£^2 - ai)e-^2(*-*^) 

= (i^- 1) (1 -e-''(*-*^)/*^) +1 (20) 
^ a - (a/t)log(l +t/a) + 1, ^ 00. 

Together, ^ and ([20]) yield that 

Rit) — , as if ^ 00. (21) 

^' a + l-(a/t)log(l + Va)' ^ ' 

In particular, if a = 1, then ()18p is met for every t > 0, and (I2ip becomes 

2 - e"* 

i?(t) ^ ^-^ — . (22) 

2-log(l+t)/i ^ ' 

Numerical experimentation suggests that, for the range < t < 2, this ratio is close to the 
maximum ratio over all two- valued random variables. 

Example 5.2 Let n = 3, and put = K^~^ for i = 1,2,3, where K is again assumed to 
be large. Let a and b be positive real numbers such that a <t and 

log(l + a/b) < a, (23) 

and let r2 = a/t, and = b/{tK). Then 

M{t) = 1 - e"* + (if - 1) (1 - e-") + K{K - 1) (l - e'^'^^ 
~ if (1 - e"" + 6) as if ^ 00. 

Next, H2 = {b/tK)K{K -1) = b{K-l)/t, fii = fi2 + {a/t){K - 1) = (a + 6)(if - l)/t, and 
Mo = /^i + 1- Hence, tl = log(^o/Mi) = log(l + l//^i) ^ 0, and so 

t*2 = tl + (t/a) log(l + a/b) ^ {t/a) log(l + a/b). 
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It follows that t2<t when K is sufficiently large, and then 



Vit) = K{K - 1) (l - e-^(*-*2)/*-^) + K 
^K[b- (b/a) log(l + a/b) + 1] . 



Thus, 

Ryt) — > ; , , . — — as -fC — > oo. 

^ ^ 1 + 6 - (b/a) log(l + a/b) 



In particular, if a = 2 and 6 = 1, then (p3|) is satisfied, and 



-2 



'^f*' ^ 2-(log3)/2 ^ * > 2- 



Note that this is the same value obtained in (j22p for t = 2. However, by admitting three- 
point distributions this ratio can be achieved for any t > 2. 

Observe from Tabled] that the smallest n for which a„ > 1.28536 is n = 8. A ratio 
arbitrarily close to og = 1.29166 can be obtained when t > log(7/a8) = 3.1781. For smaller 
values of t, however. Examples 15.11 and 15.21 provide larger ratios than the method discussed 
at the end of Section [3l 

Example 15.21 shows that the bound of Theorem 14.21 is asymptotically sharp as i | in 
the following sense. Let f{t) = 2 - (1 - e"*)/*, and g{t) = (2 - e-*)/{2 - log(l + t)/t}. 
That is, g{t) is the right hand side of (122]) . By Example 15.21 the theoretical best-possible 
ratio bound is between g{t) and f{t). Straightforward calculations show that 

f{t)-g{t) = 0{t^) as no. 

This relationship is illustrated in Figured] which also shows the uniform ratio bound from 
Theorem [32] 

A similar comparison can be made for the difference bound of Corollarv l4.5i Let f{t) = 
(3{t){l - e-*)/(/3(t) + 1- e"*). That is, f{t) is the right hand side of ([IS]) for a = 0, 6 = 1. 
Let X have the distribution given by F{X = 1) = l/(e* + 1) = 1 - P(X = (1 - e-*)/2). 
Then = t exactly, and equations ([TBI) and ([TT]) yield 



Mit) - Vit) = l[{l + e-*)(l - exp{-t/(e* + 1)}) - e-\l - e"*)] . (24) 
Let g{t) denote the right hand side of (|24p . A straightforward calculation shows that 

fit) - m = oit^) as n 0. 

Thus, the bound of Corollary 14.51 is asymptotically quite sharp as t J. 0. 
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Figure 1: The theoretical best-possible ratio bound is between the two curves g(t) and mm{f{t), 1.34149}, 
with f{t) = 2 - (1 - e-')/t, and g{t) = {2- e'^)/{2 - log{l +t)/t}. 



6 Other renewal processes: examples in discrete time 

The main purpose of this section is to show that the conclusions of Theorems 13.21 and 
13.31 may fail if the Poisson process governing the arrivals of observations is replaced by 
an arbitrary renewal process. The general setup is as follows. Let Ti,T2,... be i.i.d. 
random variables taking values in the positive integers, and assume that X, Xi, X2, ■ ■ ■ 
are i.i.d. nonnegative random variables, independent of the Tj. Call the random times 
Sk = Ti + • • • + Tfc (k G IN) the renewal times, and assume that for each k, the random 
variable Xj. is observed at time Sk- Put Sq = 0. For n € IN, let Nn = max{A; : Sk < n}. In 
other words, Nn is the number of observations that arrive by time n. As before, we wish 
to compare the values M„ := E(max{Xi, . . . , Xat^}) and Vn ■= sup^g-j- E[Xt- 1(5,- < n)], 
where T is the set of all IN-valued random variables (stopping rules) r such that {r = i} 
is measurable with respect to the u-algebra generated by Xi, . . . , Xj and Si, . . . ,Si. 

The problem will be easier to analyze if we represent it as follows. For each j E IN, 
define 



It is not difficult to see that Mn = E{Yi V • • • vy„), and Vn = supjEy,- : r is a stopping rule 
for Yi, . . . , 1^}. Thus, the problem is reduced to that of stopping an ordinary sequence of 
random variables, and standard methods can be applied to solve it. 

Observe that the Yj are, in general, neither independent nor identically distributed. 
However, there is one important exception. 

Example 6.1 Let < p < 1, and assume that P(ri = A:) = (1 - p)''-^p for /c = 1, 2, . . . . 
This yields the binomial process, which has the property that the events {j is a renewal 





0, otherwise. 
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time}, j G IN, are mutually independent and have probability p. Since the Xi are i.i.d., 
this implies that the Yj are i.i.d. with common distribution pF + (l—p)(5{o}, where F is the 
distribution of X, and 5|o} denotes Dirac measure at zero. It follows from Theorem A and 
the above representations that M„ < UnVn- Similarly, if X is [0, l]-valued then so is Yi, and 
Theorem B implies that M„ — Vn < bn- The sharpness of these inequalities depends on the 
value of p: the first bound is sharp if 1 — p < {rio,n{c(n)y^"' , that is, if p > {an/{n — 1))^/". 
Likewise, the second bound is attained if p > {(3n/{n- — l))^''"'. It is not clear how sharp 
the bounds are when p is smaller than the indicated values. 

The next example shows that the best possible ratio and difference bounds are, in 
general, strictly greater than a„ and 6„. 

Example 6.2 Fix n G IN. Let < p < 1, and assume that P(ri = I) = p = 1-P(ri = n). 
We compute Vn by backward induction. For i = 1,2, ... ,n, let 7^ denote the supremum, 
over all stopping times r such that i < r < n, of E[1V| i is a renewal time]. Then 7^ = 'EX, 
and 7j = E(X V pji^i) for i = 1, 2, . . . , n — 1, since if i is a renewal moment, then the next 
renewal moment is either i + 1 or i + n, and i + n is beyond the time horizon. Finally, 



Vn =P7l + (1 -Phn- 



(25) 



Now let X have a distribution on two points e and 1, where < e < 1, and the probability 
TT := P(X = 1) is chosen so that 

pEX = e. (26) 

It follows immediately that 7^ = EX for i = 1, . . . ,n, and hence, by (f25]) . Vn = EX. On 
the other hand, 



Mn 



EXi + Y^ E{X2 V • • • V Xfc - P(iV„ = A;) 



k=2 
n-1 



EX + J]/(l -p)(l - e)(l - vr){l - (1 - vr)^-!} 



k=2 



EX + {l-e)pir 



+ p"(l-e)(l-7r){l-(l-vr)"} 
l-Ml-7r)r 
l-p{l- vr) 



1 



where the last equality follows after routine simplification. Since EX = vr + (1 — 7r)e, ()26p 
implies that e = ptt/{1 — p{l — vr)}, and 1 — e = {1 — p)/{l — p{l — it)}. Thus, we obtain 
the expressions 



Mn-Vn 



l-p{l- vr) 



l-fr(l-7r)r 
1 -p(l - vr) 



1 



and 



Rn-=^ = f +p{l-p) 



l-Ml-vr)r 
1 -p(l - vr) 
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Now as TT J, 0, Rn increases to l+p^ — p""*"^, which is maximized for p = (2/ (n + 1))^^^"^ ^\ 
It follows that Rn can be arbitrarily close to 

\n + lj \n+l^ 
Observe that lim^^oo Cn = 2. Thus, the conclusion of Theorem 13.21 fails to hold for this 
case when n is sufficiently large. (In fact, C5 = 1.3849 > 1 + ao-) 
As for the difference -D„, note that 



p^(l -p)^(l -tt) 
hm Dn = -J- r^. (27) 

n^oo |1— p(l — Vrj)^ 

For fixed p, this is maximized at tt = (1 — p)/(2 — p), and substituting this into ([27|) yields 
that liuin^oc Dn = Thus, if we choose n sufficiently large, p sufficiently close to 1, 

and TT = {1 — p)/{2 — p), then Dn will be arbitrarily close to 1/4. 

Note that it is not known whether limsup^^^^ bn < 1/4, though Table [T] suggests this 
should be the case. If this is true, then the conclusion of Theorem 13.31 too fails to hold for 
this example. 

The last example raises an interesting question: do there exist a renewal process (in 
discrete or continuous time) and a distribution for X such that M(t;X)/V{t;X) > 2, or 
(if X is [0, l]-valued) M{t;X) - V{t;X) > 1/4? If not, why do these classical constants 
for the independent case appear as upper bounds in a problem concerning i.i.d. random 
variables? These questions may be addressed in a future paper. 
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